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Abstract 

Since the analysis by John Bell in 1965, the consensus in the literature is that 
von Neumann's 'no hidden variables' proof fails to exclude any significant class 
of hidden variables. Bell raised the question whether it could be shown that any 
hidden variable theory would have to be nonlocal, and in this sense 'like Bohm's 
theory.' His seminal result provides a positive answer to the question. I argue 
that Bell's analysis misconstrues von Neumann's argument. What von Neumann 
proved was the impossibility of recovering the quantum probabilities from a hid- 
den variable theory of dispersion free (deterministic) states in which the quantum 
observables are represented as the 'beables' of the theory, to use Bell's term. That 
is, the quantum probabilities could not reflect the distribution of pre-measurement 
values of beables, but would have to be derived in some other way, e.g., as in 
Bohm's theory, where the probabilities are an artefact of a dynamical process that 
is not in fact a measurement of any beable of the system. 



1 Introduction 

John Bell began his analysis of of the hidden variable question in quantum mechanics 
with the following statement [|T] p.447]: 

To know the quantum mechanical state of a system implies, in gen- 
eral, only statistical restrictions on the results of measurements. It seems 
interesting to ask if this statistical element be thought of as arising, as in 
classical statistical mechanics, because the states in question are averages 
over better defined states for which individually the results would be quite 
determined. These hypothetical 'dispersion free' states would be speci- 
fied not only by the quantum mechanical state vector but also by addi- 
tional 'hidden variables'-'hidden' because if states with prescribed values 
of these variables could actually be prepared, quantum mechanics would 

•Dedicated to Peter Mittelstaedt, on the occasion of his 80'th birthday. 
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be observably inadequate. ... [The present paper] is addressed to those 
. . . who beheve that 'the question concerning the existence of such hidden 
variables received an early and rather decisive answer in the form of von 
Neumann's proof on the mathematical impossibility of such variables in 
quantum theory.' 

The reference is to a comment by Jauch and Piron [5 1. Bell rejected von Neumann's 
argument as fatally flawed. In an interview for the magazine Omni (May, 1988, p. 88), 
he went so far as to state 

Yet the von Neumann proof, if you actually come to grips with it, falls 
apart in your hands! There is nothing to it. It's not just flawed, its sillyl 
. . . When you translate [his assumptions] into terms of physical disposi- 
tion, they're nonsense. You may quote me on that: The proof of von Neu- 
mann is not merely false hut foolishl 

My aim in this paper is to show that Bell's analysis misconstrues the nature of von 
Neumann's claim, and that von Neumann's argument actually establishes something 
important about hidden variables and quantum mechanics. What von Neumann proved 
was the impossibility of recovering the quantum probabilities from a hidden variable 
theory of dispersion free (deterministic) states in which the quantum observables are 
represented as the 'beables' of the theory, to use Bell's suggestive term|l That is, the 
quantum probabilities could not reflect the distribution of pre-measurement values of 
beables, but would have to be derived in some other way, e.g., as in Bohm's theory, 
where the probabilities are an artefact of a dynamical process that is not in fact a mea- 
surement of any beable of the system. 

2 The Proof 

Von Neumann's proof is set out in Chapter 4 of his book on quantum mechanics Q. 
The analysis does not begin with a summation of the principles of quantum mechan- 
ics, but with the notion of a physical system as characterized by a set of 'measurable 
quantities' and their functional relations. From the start, von Neumann is careful to 
distinguish simultaneously measurable quantities from quantities that are not simulta- 
neously measurable Q p. 297]: 

Let us forget the whole of quantum mechanics but retain the following. 
Suppose a system S is given, which is characterized for the experimenter 
by the enumeration of all the effectively measurable quantities in it and 
their functional relations with one another With each quantity we include 
the directions as to how it is to be measured — and how its value is to be 
read or calculated from the indicator positions on the measuring instru- 
ments. If 72. is a quantity and f{x) any function, then the quantity f{TZ) 

' Quoted by Mermin in 1 6 1 . 

^Bell (2| p. 174]: "The beables of the theory are those elements which might correspond to elements of 
reality, to things which exist. Their existence does not depend on 'observation.' Indeed observation and 
observers must be made out of beables." 
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is defined as follows: To measure f{TV), we measure TZ and find the value 
a (for TZ). Then f{Tl) has the value /(a). As we see, all quantities f{TZ) 
(TZ fixed, f{x) an arbitrary function) are measured simultaneously with 
TZ ... But it should be realized that it is completely meaningless to try to 
form f{TZ, S) if TZ, S are not simultaneously measurable: there is no way 
of giving the corresponding measuring arrangement. 

Von Neumann alternates between the term 'measurable quantity' and 'physical 
quantity.' It is clear from the discussion that, in the context of the hidden variable ques- 
tion, he has in mind something like Bell's notion of 'beable,' rather than 'observable,' 
the standard terminology of quantum mechanics. Observables are usually identified 
with their representative Hermitian operators, but in the following it will be important 
to keep the two notions distinct. So I will use von Neumann's term 'physical quantity' 
and distinguish physical quantities, denoted by A, B, Sx, etc., from Hermitian opera- 
tors, denoted by A,B,ax, etc. To say that a system has a certain property is to associate 
a value, or a range of values, of a physical quantity with a system. 

The statistical properties of a statistical ensemble of copies of a system S are com- 
pletely characterized by an expectation value function, defined for all physical quan- 
tities of the system. Two definitions [T, p. 312], labelled a',f3', define the notion 
of a dispersion free or deterministic ensemble, and a homogeneous or pure ensemble. 
An ensemble is dispersion free or deterministic if, for each quantity TZ, Exp(7?.^) = 
(Exp(7?.))^, so the probabilities are all or 1, and homogeneous or pure if Exp(72.) 
cannot be expressed as a convex combination of two different expectation value func- 
tions, neither of them equal to Exp (7?.). 

For von Neumann, the question of hidden variables underlying the quantum prob- 
abilities is the question of whether a quantum system can be regarded as characterized 
by certain parameters in addition to the quantum state, such that a specification of the 
values of these parameters in addition to the quantum state would 'give the values of 
all physical quantities exactly and with certainty,' as von Neumann puts it in a prelim- 
inary discussion in Chapter 3 (p. 209). That is, the question is whether the quantum 
probabilities, for physical quantities construed as beables, can be derived by averaging 
over the distribution of dispersion free states associated with a given quantum state. 

Von Neumann introduces two assumptions for physical quantities Q P- 311], la- 
belled A',B': 

A': If the quantity TZ is by nature non-negative, for example, if it is the square of 
another quantity S, then Exp(7?.) > 

B': If TZ,S, . . . are arbitrary quantities and a,b, . . . real numbers, then Exp(a7?. + 
bS+ ...) = aExp(7^) + 6Exp(5) + . . . 

Now, von Neumann emphasizes 17] p. 309] that if the quantities TZ,S, . . . are 
simultaneously measurable, then aTZ + 65 + ... is the ordinary sum, but if they are not 
simultaneously measurable, then 'the sum is characterized . . . only in an implicit way.' 
As an example |7, pp. 309-310, footnote 164], he refers to the kinetic energy of an 
electron in an atom, which is a sum of two quantities represented by noncommuting 
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operators, a function of momentum, V, and a function of position, Q: 



-p2 

and he observes that we measure the energy by the measuring the frequency of the 
spectral Hnes in the radiation emitted by the electron, not by measuring the electron's 
position and momentum, computing the values of /2m and V{Q,), and adding the 
results. 

Clearly, assumption B' is to be taken as a definition of the physical quantity oR. + 
65 + . . . when the quantities TZ,S, . . . are not simultaneously measurable, i.e., as defin- 
ing a physical quantity, X = aTZ + bS + . . ., whose expectation value is the sum 
aExp(7?.) + 6Exp(iS) + ... in all statistical ensembles (i.e., for all expectation value 
functions). 

Two further assumptions |7, pp. 313-314], I, II, relate physical quantities to 
Hilbert space operators. It is assumed that each physical quantity of a quantum me- 
chanical system is represented by a (hypermaximaljj Hermitian operator in a Hilbert 
space, and that: 

I: If the quantity TZ has the operator R, then the quantity f{TZ) has the operator 

fiR)- 

II: If the quantities Tl,S, . . . have the operators R, S, . . ., then the quantity TZ + S + 
. . . has the operator R + S + . . .. 

On the basis of the four assumptions A', B', I, II, and the two definitions a' , f3', 
von Neumann proved that the expectation value function is uniquely defined by the 
trace function: 

Exp(7^) = Ti{WR) (1) 

where 14^ is a Hermitian operator independent of R that characterizes the ensemble. It 
follows that there are no dispersion free ensembles, and that there are homogeneous or 
pure ensembles, corresponding to the pure states of quantum mechanics. 

As is well-known, Gleason's theorem [4j later established the same result on the 
basis of weaker assumptions for Hilbert spaces of more than two dimensions: in effect, 
II is required to hold only for simultaneously measurable quantities. 



3 Bell's Critique 

There is a quick argument that dispersion free ensembles are excluded if we identify 
the physical quantities of a hidden variable reconstruction of the quantum statistics 
with Hermitian operators, as I and II require, and assume that the possible values of a 
physical quantity are the eigenvalues of the representative operator. As Bell pointed out 
in UJ, for dispersion free states the expectation value of a physical quantity is equal to 
the eigenvalue in the dispersion free state, and it is clearly false that the eigenvalue of a 

^Essentially, a hypermaximal operator is the most general Hermitian operator that has a spectral resolu- 
tion. 



4 



sum of noncommuting operators is equal to the sum of the eigenvalues of the summed 
operators. For a spin- 1/2 particle, for example, the eigenvalues of and Oy are both 
±1, while the eigenvalues of + Oy are ±\/2, so the relation cannot hold. 

Now, the same argument would apply to von Neumann's example of kinetic energy 
as a sum of a function of position and a function of momentum. As von Neumann 
asserts in the footnote mentioned in the previous section, the existence of dispersion 
free or deterministic states is inconsistent with assumption II for quantities that are 
not simultaneously measurable. For example, if 7?. = jlm and S — V^(Q) are 
represented by the noncommuting operators R ~ /2ra and S = V{Q), then the 
value of the quantity £ — TZ + S — /2m + V{Q) representing the kinetic energy 
of the system could not be the sum of the values of TZ and 5 in a dispersion free state, 
if £ is represented by the operator R + S = /2m + V{Q). So Bell's observation 
could not have escaped von Neumann. 

What the quick argument shows is that we cannot identify the physical quantities 
of a hidden variable theory with Hermitian operators, according to I, II, if we require 
the existence of dispersion free states. What the argument does not show is what sorts 
of states are allowed for 'physical quantities' in a generalized sense characterized by 
the conditions A', B', I, II, and this is clearly the more interesting question. Von 
Neumann's proof is designed to answer this question, i.e., to derive the full convex 
set of quantum probability distributions, and once this question is answered, the quick 
argument is redundant. 

In 111 p. 449], Bell characterizes von Neumann's proof as follows: 

Thus the formal proof of von Neumann does not justify his informal 
conclusion: 'It is therefore not, as is often assumed, a question of reinter- 
pretation of quantum mechanics — the present system of quantum mechan- 
ics would have to be objectively false, in order that another description of 
the elementary processes than the statistical one be possible.' It was not 
the objective measurable predictions of quantum mechanics which ruled 
out hidden variables. It was the arbitrary assumption of a particular (and 
impossible) relation between the results of incompatible measurements ei- 
ther of which might be made on a given occasion but only one of which 
can in fact be made. 

The 'arbitrary assumption of a particular (and impossible) relation' is the assump- 
tion that the expectation value of a sum of measurable quantities is the sum of the 
expectation values of the summed quantities, for quantities that are not simultaneously 
measurable, represented by noncommuting operators, as well as simultaneously mea- 
surable quantities represented by commuting operators, i.e., B' together with II. The 
quotation suggests that von Neumann concluded that 'the objective measurable pre- 
dictions of quantum mechanics,' i.e., the quantum statistics, rule out hidden variables. 
This is misleading. In the comments immediately preceding this quotation, von Neu- 
mann writes |7,pp. 324-325]: 

It should be noted that we need not go any further into the mechanism 
of the 'hidden parameters,' since we now know that the established results 
of quantum mechanics can never be re-derived with their help. In fact, we 
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have even ascertained that it is impossible that the same physical quanti- 
ties exist with the same function connections (i.e., that I, II hold) if other 
variables (i.e., 'hidden parameters') should exist in addition to the wave 
function. 

Nor would it help if there existed other, as yet undiscovered, physical 
quantities, in addition to those represented by the operators in quantum 
mechanics, because the relations assumed by quantum mechanics (i.e., 
I, II) would have to fail already for the by now known quantities, those 
that we discussed above. It is therefore not, as is often assumed, . . . 

So the sense in which 'the present system of quantum mechanics would have to 
be objectively false' if the quantum statistics could be derived from a distribution of 
dispersion free or deterministic states is that, in a hidden variable theory, the associa- 
tion of known physical quantities — like energy, position, momentum — with Hermitian 
operators in Hilbert space would have to fail. 

According to Bell, von Neumann proved only the impossibility of hidden determin- 
istic states that assign values to a sum of physical quantities, TZ + S, that are the sums of 
the values assigned to the quantities TZ and S, even when TZ and S cannot be measured 
simultaneously. As we saw, von Neumann regarded a sum of physical quantities that 
cannot be measured simultaneously as implicitly defined by the statistics, and he drew 
the conclusion that such an implicitly defined physical quantity cannot be represented 
by the operator sum in a hidden variable theory. 

In im p. 448], Bell constructed a toy hidden variable theory for spin-1/2 systems, 
i.e., for quantum systems represented on a 2-dimensional Hilbert space, in which eigen- 
values are assigned to the spins in all directions, given a quantum pure state \tp) and a 
value of the hidden variable. On the face of it, this would seem to be a counterexample 
to von Neumann's theorem. 

Now in Bell's example, there is an implicitly defined physical quantity in von Neu- 
mann's sense, S — Sx + Sy, whose actual value, in a dispersion free or determin- 
istic state, is the sum of the actual values of Sx and Sy. So, trivially, Exp(5) = 
Exp(5a;) + Exp(5y) for all statistical ensembles, i.e., for the expectation values cal- 
culated by averaging over the dispersion free or deterministic states (as opposed to 
expectation values calculated via the trace formula for the representative operators). 
If, with von Neumann, we 'forget the whole of quantum mechanics,' an argument is 
required for taking the sum of the Hermitian operators ax, cry, with eigenvalues ±v^, 
as representing the physical quantity S. Similarly, some explanation is necessary to 
account for the applicability of the trace formula to the Hermitian operator ax + ay 
in generating the quantum statistics of the physical quantity S, i.e., the measurement 
statistics of the implicitly defined sum of the physical quantities Sx and Sy. This is pre- 
cisely what Bohm does in his hidden variable theory |3|, on the basis of a disturbance 
theory of measurement that generates the quantum statistics. 

For example, the momentum of a Bohmian particle is the rate of change of posi- 
tion, but the expectation value of momentum in a quantum ensemble is not derived by 
averaging over the particle momenta. Rather, the expectation value is derived via a 
theory of measurement, which yields the trace formula involving the momentum op- 
erator if we assume, as a contingent fact, that the probability distribution of hidden 
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variables — particle positions — has reached equilibrium. Bohm [T, p 387] gives an ex- 
ample of a free particle in a box of length L with perfectly reflecting walls. Because 
the wave function is real, the particle is at rest. The kinetic energy of the particle is 
E = P"^ /2m = (nh/ LY /2ra. Bohm asks: how can a particle with high energy be at 
rest in the empty space of the box? The solution to the puzzle is that a measurement of 
the particle's momentum changes the wave function, which plays the role of a guiding 
field for the particle's motion, in such a way that the measured momentum values will 
be zLnh/L with equal probability. Bohm comments pp. 386-387]: 

This means that the measurement of an 'observable' is not really a 
measurement of any physical property belonging to the observed system 
alone. Instead, the value of an 'observable' measures only an incom- 
pletely predictable and controllable potentiality belonging just as much 
to the measuring apparatus as to the observed system itself. . . . We con- 
clude then that this measurement of the momentum 'observable' leads to 
the same result as is predicted in the usual interpretation. However, the 
actual particle momentum existing before the measurement took place is 
quite different from the numerical value obtained for the momentum 'ob- 
servable,' which, in the usual interpretation, is called the 'momentum.' 

In Bohm's hidden variable theory, physical quantities are introduced as classical 
dynamical quantities, functions of positions and momenta, i.e., as beables, and the 
quantum statistics defined by the trace rule for quantum observables is an artefact of 
a dynamical process that is not in fact a measurement of any physical quantity of the 
system. For von Neumann, the physical quantities of quantum systems and their func- 
tional relations are abstracted from the measurement statistics and appropriately repre- 
sented by Hermitian operators, and the quantum theory, including the quantum theory 
of measurement, is a theory about these physical quantities. 

The pre-dynamic structure of quantum mechanics, given by the Hilbert space repre- 
sentation of physical quantities as Hermitian operators and the trace formula for expec- 
tation values, excludes hidden variables in a similar sense to which the pre-dynamic 
structure of special relativity, given by the non-Euclidean geometry of Minkowski 
space-time, excludes hidden forces as responsible for Lorentz contraction. Lorentz 
aimed to maintain Euclidean geometry and Newtonian kinematics and explain the 
anomalous behavior of light in terms of a dynamical theory about how rods contract as 
they move through the ether His dynamical theory plays a similar role, in showing how 
Euclidean geometry can be preserved, as Bohm's dynamical theory of measurement in 
explaining how the quantum statistics can be generated in a classical or Boolean theory 
of probability. 

4 Conclusion 

Von Neumann's proof establishes that if the physical quantities of quantum mechanics, 
like energy, position, momentum, etc., are characterized by the conditions A', B', I, II, 
then dispersion free states are excluded and the quantum pure states are the appropriate 
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extremal states for quantum probability distributions. So in a hidden variable the- 
ory in which dispersion free (deterministic) states are the extremal states for quantum 
probability distributions, the quantum probabilities could not reflect the distribution of 
pre-measurement values of beables, but would have to be derived in some other way, , 
e.g., as in Bohm's theory, where the probabilities are an artefact of a dynamical process 
that is not in fact a measurement of any beable of the system. What von Neumann's 
proof excludes, then, is the class of hidden variable theories in which (i) dispersion free 
(deterministic) states are the extremal states, and (ii) the beables of the hidden variable 
theory correspond to the physical quantities represented by the Hermitian operators of 
quantum mechanics. 
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